Mobile Device for Interacting with an Active Stylus

ABSTRACT

A mobile device or a method performed by a mobile device for interacting with a stylus, wherein the stylus has at least one sensor (e.g., a thermocouple junction), and wherein the mobile device has at least one signal source (e.g., an analog heat source) that produces at least one signal (e.g., at least one analog heat signal), wherein the at least one signal is configured to be detectable by the at least one sensor of the stylus. The mobile device also has at least one signal adjustment mechanism for changing the at least one signal and also has at least one transmitter (e.g., thermal active touch screen display) configured to transmit the at least one signal for receipt by the at least one sensor of the stylus.

FIELD OF THE INVENTION

The present invention relates in general to human interaction with amobile device, and more specifically to a mobile device that interactswith an active stylus and a method for interacting with such a stylus.

BACKGROUND

Advancements in mobile devices, especially progress in touch screentechnologies of mobile devices, has led to a great number of newopportunities and problems. One opportunity is the ability to providesuch devices in various sizes, including pocket sizes for smart phonesand slightly larger sizes for tablet computers. Additionally, progressin touch screen technologies has led to seamless interaction with aplethora of applications. Despite such progress, there have beenproblems with the clumsiness of such touch screens, especially onsmaller mobile devices, such as smart phones. It is common for a user'sfinger to be too large for effective interaction with a touch screen ofa smart phone, especially when icons of an application are too small ortoo close together. Furthermore, there are inadequacies in tactilefeedback between a user and a touch screen, which especially affectusers with audio and visual impairment, and there are limitations incommunicating more than one type of signal between a user and a touchscreen. For example, a user's finger can only convey a single tactilesignal, oppose to multiple signals simultaneously. Although,conventional styluses (e.g., passive styluses) have been used to relievethe issue of clumsiness, such styluses merely provide a narrower pointof contact with a touch screen than a finger. Passive styluses do notprovide feedback to a user, nor can they provide multiple signals ofinformation simultaneously. For example, there is no right-clickfunctionality on a passive stylus.

Thus, it is desirable to provide a mobile device with features toaddress these concerns.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a front perspective view of an example touch screen device.

FIG. 2 is a block diagram of the example touch screen device of FIG. 1.

FIG. 3 illustrates an example method for the touch screen device of FIG.1.

FIGS. 4-7 are cross-sectional views illustrating components of theexample touch screen device of FIG. 1.

FIGS. 8-14 and 16-18 are side perspective views of example activestyluses that can interact with the example touch screen device of FIG.1.

FIG. 15 depicts views of example active styluses interacting with theexample touch screen device of FIG. 1.

FIG. 19 is a block diagram of an example active stylus that can interactwith the touch screen device of FIG. 1.

FIG. 20 depicts a stylus that is an elongate member having a firstdistal end configured for interacting with a touch screen.

DETAILED DESCRIPTION

Disclosed herein are mobile devices that have at least one of a signalsource and/or a receiver that can communicate with an active stylus.Additionally disclosed are methods for performing such communication.The at least one signal source can be a heat and/or temperature sourceand the at least one receiver can be a heat and/or temperature sensor,or the two devices can be combined into a heat and/or temperaturetransceiver (also referred to as a thermal transmitter, a thermalreceiver, and a thermal transceiver, respectively). These thermaldevices in actuality sense and/or transfer heat (also referred to asreceiving and/or transmitting heat) from and/or to other devices orobjects, respectively. Alternatively, the at least one signal source andreceiver can be any known wireless signal transmitter, receiver, ortransceiver, including wireless communication devices that communicateby way of mechanical signals (e.g., vibration patterns, acousticalsignals, mechanical deformation signals), and/or electromagnetic signals(e.g., various light or radio signals). In one embodiment, the thermaltransceiver is one or more thermocouple junction.

Likewise, the active stylus that communicates with the mobile devicescan also include a signal source and receiver similar to those of themobile devices. By enabling communication beyond a mere touch pointbetween a stylus and a mobile device, the disclosed mobile devices andmethods provide more dynamic interaction and help resolve the size andlack of feedback issues discussed prior.

Referring to FIG. 1, a front perspective view of an example embodimentof the mobile device 102 is illustrated, which can take the form of amobile phone, personal digital assistant, remote controller, electronicbook reader, tablet, or portable video game console and can includefunctions such as calling, emailing, texting, image acquisition,internet browsing functions, gaming, as well as others. The mobiledevice 102 includes a movement sensing assembly, which in FIG. 1 takesthe form of a touch detecting surface 104 associated with a displayscreen 108 to form a touch screen 106, where the touch screen 106 ishoused with other components in a housing structure 110. The touchdetecting surface 104 can be any of a variety of known touch detectingtechnologies such as a resistive technology, a capacitive technology, oran optical technology. Further, the touch detecting surface 104 caninclude or be replaced by a thermocouple junction or a thermocouplejunction network as shown in FIGS. 4 and 5, respectively. Asillustrated, the touch detecting surface 104 includes a light permeablepanel or other technology that overlaps the display screen 108 (such asa liquid crystal display screen). Alternately, the movement sensingassembly could be a touchpad (not overlapping the display screen), ajoystick, a mouse, or other types of user interfaces.

Referring to FIGS. 4-7, cross-sectional views of components of theexample mobile electronic device 102 show how example movement sensingassemblies can be situated with other components of the example mobileelectronic device 102. FIGS. 4 and 5 illustrate a display lens 402 lyingover a thermocouple junction network 404 that is above a display screen508. As shown in FIG. 18, in one embodiment, the thermocouple junctionnetwork 404 is made up of a substantially transparent conductor layercontaining dissimilar conductor types to form thermocouple junctions,such as a combination of an indium tin oxide (ITO) layer and a doped ITOlayer with other materials 502 on a polyester film (e.g., PET film) 504.The thermocouple junctions can be derived using dissimilar metals (orother types of materials) joined at a point where heat is generated atthat point following the application of a voltage at terminals of thedissimilar metals. The reverse is true as well, where a voltage isgenerated at the terminals in relation to a junction's temperature. Inan alternative embodiment, any type of insulator layer, such as glass,can replace the PET film. Similar to capacitive or resistive typemovement sensing assemblies the thermal type assemblies measure touchesby a grid. However, beyond mere contact or closing of a circuit, thethermal type assemblies can add an additional parameter to theircommunications, which is a specific amount of heat, a specifictemperature, or a combination of the two (hereinafter one of thesealternative signals is referred to as a heat and/or temperature signal).It should be noted that using such a grid is preferred, considering thesize of a touch screen on a small mobile device, such as a smart phone.

FIG. 5 further illustrates an air gap 506 that can be found between amovement sensing assembly, such as the thermocouple junction network404, and the display screen 508. An advantage of the thermocouplejunction network 404 over other forms of movement sensing assemblies isthat the heat from the thermocouple junction network 404 can be used toevaporate moisture that can get trapped in the air gap 506. Anotheradvantage is that the network 404 can burn off oils or grime that candistort the electric field of capacitive type touch detectionassemblies.

FIGS. 6 and 7, further illustrate an alternative embodiment wherethermochromic film 602 is laminated to the ITO layer 502 of thethermocouple junction network 404. Another advantage of using thethermocouple junction network 404 is that it can be combined with thethermochromic film 602, so that the film 602 can be modified by thethermocouple junction network 404 to improve the display visibilityunder different lighting conditions.

Referring to FIG. 2, a block diagram 200 illustrates example internalcomponents of a mobile smart phone implementation of the mobile device102. These components can include wireless transceivers 202, a processor204 (e.g., a microprocessor, microcomputer, application-specificintegrated circuit, or the like), memory 206 (which in at least someembodiments, the processor 204 and the memory 206 are on one integratedcircuit), one or more output components 208, one or more inputcomponents 210, and one or more sensors 228. The device can also includea component interface 212 to provide a direct connection to auxiliarycomponents or accessories for additional or enhanced functionality, anda power supply 214, such as a battery, for providing power to the otherinternal components. All of the internal components can be coupled toone another, and in communication with one another, by way of one ormore internal communication links 232, such as an internal bus.

The memory 206 can encompass one or more memory devices of any of avariety of forms (e.g., read-only memory, random access memory, staticrandom access memory, dynamic random access memory, etc.), and can beused by the processor 204 to store and retrieve data. The data that isstored by the memory 206 can include operating systems, applications,and informational data. Each operating system includes executable codethat controls basic functions of the electronic device, such asinteraction among the various internal components, communication withexternal devices via the wireless transceivers 202 and/or the componentinterface 212, and storage and retrieval of applications and data to andfrom the memory 206. Each application includes executable code thatutilizes an operating system to provide more specific functionality forthe communication devices, such as the facilitating communicationbetween the mobile device 102 and an active stylus as illustrated inFIG. 3.

As for programs (applications), each program includes executable codethat utilizes an operating system to provide more specificfunctionality, such as the facilitating communication between the mobiledevice 102 and an active stylus as illustrated in FIG. 3. Although manysuch programs govern standard or required functionality of the mobiledevice 102, in many cases the programs include applications governingoptional or specialized functionality, which can be provided in somecases by third party vendors unrelated to the mobile devicemanufacturer.

Finally, with respect to informational data, this is non-executable codeor information that can be referenced and/or manipulated by an operatingsystem or program for performing functions of the mobile device 102.Such informational data can include, for example, data that ispreprogrammed upon the mobile device 102 during manufacture, or any of avariety of types of information that is uploaded to, downloaded from, orotherwise accessed at servers or other devices with which the mobiledevice 102 is in communication during its ongoing operation.

Additionally, the mobile device 102 can be programmed such that theprocessor 204 and memory 206 interact with the other components of themobile device to perform a variety of functions, including the methodillustrated by FIG. 3. Although not specifically shown in FIG. 2, theprocessor can include various modules for performing the method of FIG.3. Further, the processor can include various modules for initiatingdifferent activities known in the field of mobile devices and describedherein.

The wireless transceivers 202 can include both cellular transceivers 203and a wireless local area network (WLAN) transceiver 205. Each of thewireless transceivers 202 utilizes a wireless technology forcommunication, such as cellular-based communication technologiesincluding analog communications (using AMPS), digital communications(using CDMA, TDMA, GSM, iDEN, GPRS, EDGE, etc.), and next generationcommunications (using UMTS, WCDMA, LTE, IEEE 802.16, etc.) or variantsthereof, or peer-to-peer or ad hoc communication technologies such asHomeRF, Bluetooth and IEEE 802.11(a, b, g or n), or other wirelesscommunication technologies.

Example operation of the wireless transceivers 202 in conjunction withthe other internal components of the electronic device 102 can take avariety of forms and can include, for example, operation in which, uponreception of wireless signals, the internal components detectcommunication signals and the transceiver 202 demodulates thecommunication signals to recover incoming information, such as voiceand/or data, transmitted by the wireless signals. After receiving theincoming information from the transceiver 202, the processor 204 formatsthe incoming information for the one or more output components 208.Likewise, for transmission of wireless signals, the processor 204formats outgoing information, which can or can not be activated by theinput components 210, and conveys the outgoing information to one ormore of the wireless transceivers 202 for modulation as communicationsignals. The wireless transceiver(s) 202 convey the modulated signals toa remote device, such as a cell tower or an access point (not shown).

The output components 208 can include a variety of visual, audio,mechanical, and/or thermal outputs (such as heat and/or temperatureoutput signals). For example, the output components 208 can include oneor more visual output components 216 such as the display screen 508. Oneor more audio output components 218 can include a speaker, alarm, and/orbuzzer, and one or more mechanical output components 220 can include avibrating mechanism for example. Furthermore, the display screen 508 canemit thermal signals whether heat and/or temperature signals. Similarly,the input components 210 can include one or more visual input components222 such as an optical sensor of a camera, one or more audio inputcomponents 224 such as a microphone, and one or more mechanical inputcomponents 226 such as the touch detecting surface 104 and the pushbutton 112 of FIG. 1. Additionally, the display screen 508 and othercomponents can include a thermocouple junction or a thermocouplejunction network for inputting the thermal signals (also referred to asheat and/or temperature signals).

Actions that can actuate one or more input/output components 210/208 caninclude for example, powering on, opening, unlocking, moving, touchingwith an end of an active stylus, and/or operating the device 102. Forexample, upon power on, a ‘home screen’ with a predetermined set ofapplication icons can be displayed on the display screen 508.

The sensors 228 can include both proximity sensors 229 and other sensors231, such as an accelerometer, a gyroscope, or any other sensor that canprovide pertinent information, such as to identify a current location ororientation of the device 102.

Referring back to FIG. 1, the mobile device 102 is operable to detectand identify various gestures by a user (where each gesture is aspecified pattern of movement of an external object, such as movementfrom one or more fingers or movement from an end of a stylus or activestylus, relative to the device). The touch screen 106 is advantageousbecause changeable graphics can be displayed directly underlying thetouch detecting surface on which controlling hand gestures are applied.Furthermore, the touch screen 106, as mentioned above, can include athermocouple junction network or another form of a temperature or heatsource that can provide for an even more dynamic interaction between thetouch screen 106 and a user by propagating heat and/or temperaturesignals and in some embodiments receiving such signals. Additionally,other elements of the user interface of the mobile device can be able todetect the gestures by the user, and at least one of such elementspossibly has a thermocouple junction beneath it as well.

Examples of such dynamic interaction are explained in the followingparagraphs, and since the touch screen 106 is configured to at leastinteract with at least one active stylus it is fitting to discuss the atleast one active stylus in greater detail afterwards.

FIG. 3 illustrates a method 300 that can be performed by the mobiledevice 102, such as at a time when application icons, text or othervisual content, a canvas, form elements, and/or other graphical userinterface components are displayed for interacting with the touch screen106. The method begins at a step 302, where a signal source, such asheat source, produces an analog signal. As noted in one embodiment, thesignal source is an analog heat source, such as a thermocouple junctionor at least one thermocouple junction of a thermocouple junctionnetwork, and the analog signal is a heat and/or temperature signal.Alternatively, the signal that is produced by the signal source can be adigital signal.

At a step 304, while the signal source produces one of theabove-mentioned signals of the step 302, the device 102 possiblyoperates to receive modifications to the signal or input that leads toan additional signal of the same type.

At a step 306, the signal is transmitted from the mobile device 102 toan active stylus. In the present embodiment, the signal is transmittedfrom a sole thermocouple junction or a thermocouple junction of athermocouple junction network 404, which in either case it is part ofthe touch screen 106.

At a step 308, the signal is received at a receiver of the stylus.Typically, the receiver is at an end of the stylus, where the stylususually has two ends and a shaft in between the ends. In the presentembodiment, the receiver of the stylus is a thermocouple junction.Additionally, the receiver of the stylus can be combined with atransmitter of signals of a similar type, so that such transceivers ofthe mobile device 102 and the stylus can be configured for sending andreceiving analog and/or digital signals of a similar type.

At a step 310, in the present embodiment, assuming that the signaltransmitted from the one of the mobile device at the step 306 is ananalog signal, such as an analog heat and/or temperature signal, theanalog signal is transformed to a digital signal. In one embodiment, theprocessor of the stylus 1904 transforms the analog signal to the digitalsignal. Alternatively, in other embodiments where the signal transmittedat the step 306 is already a digital signal, the signal does not have tobe transformed; however, modulation of the signal can be requiredespecially where signal quality is of concern. Where modulation isrequired, a processor of the stylus facilitates such modulation.

At a step 312, the digital signal, whether modulated or not, ortransformed from the above-mentioned analog signal, is inputted as aparameter for an executed program running on the stylus. Upon receivingthe input, the program takes one or more actions, one possibly beingcausing the output of a user observable signal as noted in a step 314.The user observable signal can be presented in various forms, includinga heat and/or temperature signal, a visible light signal, an audiosignal, and/or a mechanical or haptic signal such as a vibration,movement, and/or force.

Since the touch screen 106 is configured to at least interact with oneor more active styluses, it is fitting to discuss such active stylusesin detail.

Referring to FIGS. 8-19, the figures depict various examples of activestyluses that are capable of interacting with a touch screen 106 orother components of the mobile device 102 as shown in FIG. 1. Although,the active styluses of FIGS. 8-18 for the most part communicate with themobile device 102 through a temperature or heat signal, it should beunderstood that in alternative embodiments of the styluses and themobile device, interaction can occur through the communication of otherforms of signals as mentioned above.

Turning attention to FIG. 19, depicted is a block diagram 1900 ofexample internal components of active styluses, including the activestyluses of FIGS. 8-19. The internal components of active styluses caninclude wireless transceivers 1902, a processor 1904 (e.g., amicroprocessor, microcomputer, application-specific integrated circuit,or the like), memory 1906, one or more output components 1908, one ormore input components 210, and one or more sensors 1928. The stylus canalso include a component interface 1912 to provide a direct connectionto auxiliary components or accessories for additional or enhancedfunctionality, and a power supply 1914, such as a battery, for providingpower to the other internal components. All of the internal componentscan be coupled to one another, and in communication with one another, byway of one or more internal communication links 1932, such as aninternal bus.

The memory 1906, similar to the memory of the mobile device 102, canencompass one or more memory devices of any of a variety of forms (e.g.,read-only memory, random access memory, static random access memory,dynamic random access memory, etc.), and can be used by the processor1904 to store and retrieve data. The data that is stored by the memory1906, similarly, can include operating systems, applications, andinformational data, where such data is comparable to the data stored bythe memory of the mobile device 102, except for the fact that the datastored is geared towards operation of the active styluses oppose tooperation of the mobile device 102. Given this, one of the activestyluses can be programmed such that the processor 1904 and memory 1906interact with the other components of the stylus to perform a variety offunctions, including interaction with the mobile device 102, such as theinteractions shown in FIG. 15.

Referencing FIG. 15, illustrated is an active stylus 1506 with a pointedend 1507 interacting with the mobile device 102, and two active styluses1502 and 1504 with brush ends 1503 and 1505, respectively, interactingwith the mobile device 1502. In these examples, each of respective endsof the styluses 1502, 1504, or 1506 upon contact with the touch screen106 is transmitting a heat and/or temperature signal to one or morethermocouple junctions of a thermocouple junction network, so that thesignal transmitted reflects the area of the end contacting the touchscreen 106. In turn, visual output 1510, 1512, or 1514 of the touchscreen 106 reflects the area of the end of the stylus in contact withthe screen 106. Vice versa, the touch screen 106 upon contact with theend of one of the active styluses 1502, 1504, or 1506 can transmit aheat and/or temperature signal to one or more thermocouple junctions ofthe respective ends 1503, 1505, or 1507, so that the signal transmittedreflects the area of the screen 106 transmitting the signal andcontacting the end; and in turn the output of the one of the respectivestyluses 1502, 1504, or 1506 reflects the area of the screen 106transmitting the signal and contacting the respective end 1503, 1505, or1507 of one of the styluses.

Referring back to FIG. 19, in general, the styluses can be programmedsuch that the processor 1904 and memory 1906 interact with the othercomponents of the styluses to perform a variety of functions, includingthe method illustrated by FIG. 3. Although not specifically shown inFIG. 19, the processor 1904 can include various modules for performingthe method of FIG. 3. Further, the processor can include various modulesfor initiating different activities known in the field of activestyluses and activities described herein.

Additionally, the wireless transceivers 1902 can include transceiverssimilar to the wireless transceivers 202 of the mobile device 102.Similarly, example operation of the wireless transceivers 1902 inconjunction with other internal components of the active stylus can takea variety of forms and can include similar operations that occur in themobile device 102.

The output components 1908 can include a variety of heat and/ortemperature 1916, audio 1918, and/or mechanical output components 1920,including output components similar to those of the mobile device 102.Additionally, some embodiments of the active stylus can even outputvisual information. In one noteworthy embodiment, one of the heat and/ortemperature output components 1916 and/or the mechanical outputcomponents 1920 can present a code to users with audio and visualimpairment so that such users can experience the content presented bythe mobile device 102 via the code, when an end of one of the activestyluses is in contact with the portion of the touch screen 106displaying the content.

The input components 1910 can include a variety of heat and/ortemperature 1922, audio 1924, and/or mechanical input components 1926,including input components similar to those of the mobile device 102.Similar to the output components 1908, the input components 1910,facilitate interaction with a user as well has interaction with themobile device 102. Further, actions that can actuate one or moreinput/output components 1910/1908 can include for example, powering on,opening, unlocking, moving, and/or operating one of the styluses.

Additionally, the styluses can include sensors 1928 including bothproximity sensors 229 and other sensors 231, such as an accelerometer, agyroscope, or any other sensor that can provide pertinent information,such as to identify a current location or orientation of the stylus 102.

Turning to FIGS. 9, 10, 13, and 14, example output components thattransmit various heat and/or temperature signals to a possiblethermocouple junction network of the touch screen 106 when in contactwith the touch screen 106 (or in close enough proximity to the touchscreen 106 to transmit a heat and/or temperature signal) are shown. Thestyluses 900, 910, 920, and 930 of FIG. 9 each have two heat conductingsurfaces, where one of the conducting surfaces of each pair conductsheat differently than the other of the pair, so as to facilitatetransmitting and/or receiving at least two different heat and/ortemperature signals. For example in the styluses 900, 910, 920, and 930,the respective heat conducting components 902, 912, 922, and 932 conductmore heat, so such can facilitate the styluses performing an interactionwith the touch screen 106, such as writing, selecting, and painting in afirst color. By contrast, the respective heat conducting components 904,914, 924, and 934 conduct less heat, so those components can facilitatethe styluses performing an opposing interaction with the touch screen106, such as erasing, deselecting, and painting in a second color. Inanother example, referring particularly to FIG. 10, the active styluses1000, 1010, 1020, and 1030 are configured to receive detachable andreplaceable heat conducting attachments 1002, 1012, 1022, and 1032,respectively, where each of the different attachments conducts heatdifferently, so that various heat and/or temperature signals aretransmitted and/or received by the stylus depending upon the attachment.Such an embodiment can have various applications, such as being able todraw various colors to the touch screen 106, where each detachable heatconducting component 1002, 1012, 1022, and 1032 causes a different colorto be outputted by the display of the mobile device 102.

Besides varying the effectiveness of conducting heat, the area of theend of the stylus that comes in contact and communicates with the touchscreen 106 of the mobile device 102 can also be varied. For example, theend of a stylus can be pointed (e.g., an end 1302 of stylus 1300), blunt(e.g., an end 1304 of stylus 1300), multiple pointed (e.g., an end 1312of stylus 1310), round (e.g., an end 906 of stylus 900), flat but narrow(e.g., both ends 916 and 918 of stylus 910), and brush-like havingfilaments (e.g., respective ends 1402 and 1412 of respective styluses1400 and 1410). The brush-like ends 1402 and 1412 can vary greatly inthat the filaments can vary in thickness, and each filament can varyvertically in heat conductivity. By varying the heat conductivityvertically along each filament, the heat and/or temperature signalvaries vertically; and therefore, using such an end with a paintapplication the end can simulate effects of a real paintbrush, such asgreater color density at the tip of the brush. Varying the thickness ofeach filament and the amount of filaments on a brush-like end can alsofacilitate simulating the effect of a real paintbrush. Further, theduration of time the filaments are in contact with the touch screen 106can alter the signal received by the stylus and then transmitted back tothe device 102, and vice versa. For example, intensity of a colorselected from a displayed color palate can increase as the filamentsstay in contact with the palate, which is analogous to fibers of a brushabsorbing more paint as the brush sits in the paint for a longerduration of time. Additionally, the force that the filaments apply tothe touch screen 106 can also affect the signal received by the stylusand then transmitted back to the device 102, and vice versa. Likewise, amore forceful brush stroke could increase the color intensity of a lineadded to a virtual canvas.

With reference to FIGS. 8, 11, 12, 16, 17, and 18, illustrated areactive styluses that interact with the mobile device 102 that includeone or more signal adjustment mechanisms.

Specifically, FIG. 8 depicts active styluses 800, 810, and 820 eachhaving a respective signal adjustment mechanism 802, 812, and 822 (e.g.,a heat and/or temperature signal adjustment mechanism) for modifying atleast one signal (e.g., for increasing and decreasing the amount of heator the temperature for at least one heat or temperature signal), wherethe signal adjustment mechanism can include a push button 802, a slidemechanism 812, and a turnable knob 822 having at least two states forvarying the at least one signal so that the variation is distinguishableto at least one receiver (e.g., a thermocouple junction) of the mobiledevice 102. In the embodiment where there is a push button 802,typically the push button 802 has only two states that vary the signal,whereas in embodiments having the slide mechanism 812 or the turnableknob 822, there are usually more than two states that vary the signal.Furthermore, in embodiments having the slide mechanism 812 or theturnable knob 822, the signals that are caused by changing the state ofthe signal adjustment mechanism can vary continuously. For example,where the form of the signal is a heat and/or temperature signal, thetemperature or the amount of heat can vary continuously; therefore, thesignal is modified continuously with practically infinite variations.However, in such cases, the number of variations detectable depends onthe quality of the at least one receiver (e.g., the thermocouplejunction) of the mobile device 102 and the propagating transmitter(e.g., a thermocouple junction) of the stylus.

With reference to FIGS. 12 and 18, depicted specifically are push buttonand pressure sensitive adjustment mechanisms 1202, 1212, 1806, and 1804,where pressure is applied to the signal adjustment mechanisms 1202,1212, 1806, and 1804, respectfully, usually by a user's finger. In thecase of the stylus on the left 1200, downward pressure 1206 to thesignal adjustment mechanism 1202 causes a conductive material (e.g.,metal) 1204 to compress vertically and therefore become more resistiveand produce a greater amount of heat or a higher temperature. The sameis the case for the stylus on the right 1210, except horizontal inwardpressure 1216 towards the signal adjustment mechanism 1212 causes theconductive material 1214 to compress horizontally and in turn produce agreater amount of heat or a higher temperature. In the case of thestylus of FIG. 18, the stylus 1800 has multiple push button signaladjustment mechanisms (e.g., mechanisms 1804 and 1806), where pressingeach button varies the amount of heat or the temperature propagated fromthe end 1802 of the stylus 1800. Alternatively, fixed resistivitymaterials can be used to facilitate the aforementioned functionalities.In this alternative, materials with fixed resistivity can be used tocouple body heat to the stylus differently at different locations of thestylus (e.g., a green colored area of the stylus conducts more heat thana blue area due to the material of the green area having greater heatconducting properties, or different areas of the stylus having differentphysical features such as bumps or ridges oppose to a smooth surface).

Alternatively, force-sensing resistors can be used to facilitate theaforementioned functionalities as shown in FIG. 8.

With reference to FIG. 17, depicted specifically are example embodimentsof styluses 1700, 1710, 1720 having respective slide and turnable knobtype signal adjustment mechanisms, where generally these mechanismsinclude a part 1706, 1716, and 1726 that encloses part of the shaft1704, 1714, and 1724, respectively. Specifically, the stylus 1700 has ahousing part 1706 that surrounds the shaft 1704. The housing part 1706in this case is at least part of the signal adjustment mechanism, wherea user can push or pull the housing part 1706 along the shaft 1704 tomodify the signal propagated from the end 1702. The stylus 1710 has ahousing part 1716 with threads 1718 that mate with threads (notdepicted) on the outer surface of the shaft 1714. Similarly, thishousing part 1716 encircles the shaft 1714 and is at least part of thesignal adjustment mechanism. In this case, the user can turn the housingpart 1716 so that the housing moves along the shaft 1714 modifying thesignal propagated from the end 1712. Similar to the stylus 1710, thestylus 1720 has a part 1726 of the signal adjustment mechanism that theuser can turn to modify the signal propagated from the end 1722 of thestylus 1720. Unlike the styluses 1700 and 1710, the movement of the part1718 along the shaft 1724 towards the end 1722 is not stopped by theother end 1725 of the stylus 1720. Whereas the other ends 1705 and 1715can act as stops on the styluses 1700 and 1710, respectively. On thestylus 1700 the ends 1727 and 1729 of a thread 1728 on the outer surfaceof the shaft 1724 are the stops. Likewise, the thread 1728 mates with athread (not depicted) of the adjustment part 1726 to facilitate theturning of the part 1726. Regarding the signal propagated from the ends1702, 1712, 1722, respectively, of these styluses 1700, 1710, and 1720,respectively, similar to the other active styluses mentioned herein, thesignal adjusted can be a heat and/or temperature signal.

With reference to FIGS. 11 and 16, depicted specifically are signaladjustment mechanisms 1102, 1604, 1614, 1623-1627, 1634, and 1635,respectively, where each include heat conducting material that coversthe outside of the shaft or include at least one sensor on or beneaththe outer surface of the shaft, where either form of implementationcommunicates to the internal components of each stylus body heat ortemperature emitted from a user's finger or hand. Some implementationsof such signal adjustment mechanisms include thermocouple junctions thattransform the heat and/or temperature signal from the user's finger toan electric signal, which is then communicated via circuitry of theactive stylus, which in turn communicates the electric signal to athermocouple junction at the end of the stylus. This end thermocouplejunction then transforms the electric signal into a heat and/ortemperature signal that can be propagated to the mobile device 102,which receives the signal at its own thermocouple junction that istypically part of a thermocouple junction network. In one alternative ofthis embodiment, when the user touches the stylus at the signaladjustment mechanism or heat/temperature input component, the processorof the stylus sets a delta variable, which represents the difference intemperature between the tip and the user's finger at point of contactwith the input component. In turn, the user touches the stylus to thetouch screen 106, and the delta variable is transmitted to and recordedby the device 102. Subsequently, when the user's finger temperaturechanges or the user is wearing a glove a new delta value is transmittedto and recorded by the device 102, which allows the processor of thedevice 102 to make several deductions about the user and the environmentof the user, such as the user is outside and wearing a glove or the userhas a fever. In some other implementations, where possible, the signaladjustment mechanism merely conducts the heat from the user's finger tothe end of the stylus.

With particular reference to the styluses of FIG. 16, the figure depictsalternative layouts of such signal adjustment mechanisms. In the case ofthe stylus 1600, there is one signal adjustment mechanism 1604 thatmerely communicates to the stylus 1600 that it is being touched or heldby a user. In the cases of the styluses 1610, 1620, 1630, and 1640 thereare more than one region along the shaft of each stylus, where eachregion facilitates different input into the stylus as if each region isa separate signal adjustment mechanism. Specifically, the stylus 1610has continuous changing regions 1614 along the shaft that facilitate auser inputting continuously different inputs (which can be particularlyuseful in drawing applications and applications that simulate a musicalinstrument such as a trombone). Further, the stylus 1610 can varycontinuously in a linear or non-linear fashion. The styluses 1620, 1630,and 1640 have respective multiple but discrete regions 1623-1627 and1641-1645 (in series) and 1634-1635 (in parallel) that facilitatediscrete inputs by the user, where these styluses 1620, 1630, and 1640can also vary linearly or non-linearly, respectively. Further, wherethere is a greater amount of discrete regions, such as in the stylus1620, such regions can be useful for drawing and musical applicationswhere discrete shades or tones are preferred.

Although not depicted, the mobile device 102 can also include similarsignal adjustment mechanisms as the styluses described above and as thestyluses depicted in FIGS. 8-19. In other words, the mobile device 102can also include signal adjustment mechanisms that can adjust a heatand/or temperature signal.

Whether the signal is eventually communicated to the mobile device 102from one of the styluses, or vice versa, it should be appreciated that avariety of applications can take advantage of modifying continuously ordiscretely signals generated by the styluses. The following are a numberof example applications that take advantage of a continuum of varyingsignals or a discrete set of varying signals. Zoom, focus, contentrewrapping, brightness, contrast, hue, tint, volume control, audiolevels, and any other manner of altering the audio/visual user interfacedisplayed or presented by the device 102 would benefit from being ableto be altered continuously. Additionally being able to alter anyparticular element displayed to the user would also benefit fromcontinuous adjustment, such as altering colors or tones. Contrary,altering such things, such as text language, font format, or font sizecan benefit from being able to adjust the signal discretely (font sizecan also benefit from continuous adjustments). Discrete control of thesignal is also useful for performing actions on content or executableicons of a graphic user interface of the device 102, such as selecting,cutting, copying, and pasting content, or executing an applicationassociated with the icon and right-clicking the icon (e.g., opening amenu related to the icon or performing another action besides executingthe application associated with the icon). Discrete control is alsouseful for shifting, number locking, and capital letter locking.

As noted previously there are several useful applications in the subjectmatter of this disclosure. For example, generally taught herein are morerobust manners for interacting with a mobile device. Further, thedescribed dynamic interactions between the mobile device 102 and theactive styluses facilitate more enriching applications than contemporarysolutions. For example, the above-mentioned methods and the mobiledevice 102 can provide for interaction between an active stylus and thetouch screen 106 so that for example visually impaired can perceive theinformation displayed by the screen 106. Additionally the device 102 andthe methods can facilitate a thermally sensitive brush/stylus tointeract with the screen 106 to simulate a more realistic painting ordrawing experience, such as simulating the mixing of colors on asimulated color pallet. Furthermore, colors or information in generalcan be transferred via the active stylus to other mobiles devices havingsimilar technologies to the device 102. Another possible benefit of thedevice 102 is handwriting recognition, where the thermal interactionbetween the device 102 and one of the styluses provides for moreinformation concerning handwriting recognition than if merely a passivestylus was used.

The methods and device 102 also allow for more refined touch interactionthan touching with a user's finger. A fine touch can be usefulespecially when making edits to a displayed photograph. For example,fine-tuning coloring of a subject, cropping, or removing red eye can beenhance by an active stylus. Additionally, the fine touch of a stylusand the options provided by an active stylus allow for variousapplications to have more options in a displayed area and also allowsuch options to have multiple dimensions. Further, using a stylus can bemore ergonomic than using a finger to interact with a touch screen,especially when taking handwritten notes.

As noted previously and as understood by those in the art, theprocessors 204 and 1904 execute computer program code to implement themethods described herein. Embodiments include computer program codecontaining instructions embodied in tangible media, such as a miniature-or micro-flash memory card or any other processor readable storagemedium of appropriate size, where, when the computer program code isloaded into and executed by a processor, the processor becomes anapparatus for practicing the invention. Embodiments include computerprogram code, for example, whether stored in a storage medium, loadedinto and/or executed by a processor, or transmitted over sometransmission medium, such as over electromagnetic wiring or cabling,through fiber optics, or via thermal radiation, where, when the computerprogram code is loaded into and executed by a processor, the processorbecomes an apparatus for practicing the invention. Further, the computerprogram code segments configure the microprocessor to create specificlogic circuits.

It is specifically intended that the present invention not be limited tothe embodiments and illustrations contained herein, but include modifiedforms of those embodiments, including portions of the embodiments andcombinations of elements of different embodiments as come within thescope of the following claims.

Example Embodiments of the Active Stylus

As mentioned previously, since the touch screen 106 is configured to atleast interact with at least one active stylus it is fitting to discussthe at least one active stylus in greater detail. Disclosed in thissection are more examples of active styluses that can interact with themobile devices.

Disclosed in this section are active styluses and methods performed bysuch styluses that, when in contact with a touch screen, can vary thesignal level detected on a touch screen to create a more realisticwriting experience and a more dynamic user experience. The elements of adisclosed stylus can include at least one feature to provide at leastone thermal characteristic that is variable.

Disclosed in this section are elements of a touch screen stylus aredisclosed, which individually or in combination can enable a touchscreen stylus to have at least one thermal characteristic that isvariable. In this way a link between the touch screen and a signaltransmitting element can be varied to enable features such as acapability to vary the width of line being drawn and/or to vary a regionof influence on the touch screen.

For example, the larger the signal received by the touch screen, thelarger the area of the image created. That is more received signal canresult in a wider line and less received signal can result in a thinnerline. A user can control the signal variability by controlling where theuser's finger touches the stylus. For example, coatings and/orinsulators such as a rubber grip with contact slots, and/or variationsin the texture of the surface of the stylus so as to reduce the skincontact area can allow the user to control the conductivity of otherthermal properties of the stylus. In another embodiment, sandwiching twomaterials of different levels of conductivity (one stronger, one weaker)can thermally create a beveled edge device. In any of the disclosedmanners, and any combinations thereof, the disclosed stylus can vary thesignal level detected on a touch screen to create a more realisticwriting experience and dynamic user interaction. Such occurs due to atouch sensor (e.g., movement sensing assembly) viewing the changes in asignal caused by the stylus and relate these changes to the userinterface layer, and vice versa.

In one embodiment, a signal variation can be enabled depending on wherethe stylus is held. A combination of elements can includesegmented/laminated/variable in axial construction to providelongitudinal variation; segments in resistor series to provide lineargradients; segments in series/parallel combinations to providelinear/non-linear profiles; rheostat-like resistor windings with one ormore slidable indexing collars; and rheostat-like resistor windings withone or more screwable indexing collars. In another embodiment,additionally, or in the alternative to where the stylus is held, aresistive link variation can be enabled depending on how the stylus isheld. A combination of elements can include, surface roughness elementswhich can include varying density and height to vary contact resistance,segmented/laminated in lengthwise construction to provide rotationalvariation and replaceable tips of varying geometry.

FIG. 20 depicts a stylus that is an elongate member 2002 having a firstdistal 2004 end configured for contact with a touch screen and a seconddistal end 2008 opposite the first distal end 2004. The elongate member2002 has at least one thermal characteristic that is variable, forexample when the elongate member 2002 is in contact with a touch screen,the variable thermal characteristic can be at least one of temperatureand/or an amount of heat energy. In one embodiment, the base material iscovered with a conductive rubberized coating. The distal end 2004 of theelongate member 2002, or of any elongate member described herein, caninclude a tip for contact with the touch screen. In one example, the tipcan be a compliant conductive rubber allowing for compression to createdifferent areas of contact, and thus line width.

As discussed above, it can be beneficial were a stylus to perform morelike a physical pen and paper. With thickness, stroke or swath control,a user can better personalize input to the device. For example, as shownin FIG. 20, an example script 2012 depicted upon the touch screen hasvarying thickness, stroke or swath. The image constituted by the script2012 on the touch screen can be processed by a handwriting recognitionalgorithm present on the mobile device, and/or can become a file or aportion of a file in and of itself. The file can be transferred in anysuitable manner, for example, uploaded so that it can be sent to anotherdevice. In this way, a personalized message in a personal script can betransmitted. For example, the depicted script 2012 says “Thx”, which auser can wish to convey in a personal manner.

In one embodiment, when portions of the elongate member 2002 havingdifferent thermal properties are in series, and/or in any otherdisclosed stylus, a positioning of the grounding or thermal inputelement, such as a user's grip, can provide control of the thicknessstroke or swath. In the present embodiment, the grounding or thermalinput element is shown in a position 2014. Were the position of thegrounding or thermal element to be moved to a position 2016, or anyother suitable position, the thickness, stroke or swath of a line madeby the elongate member 2002 upon the touch screen can be a differentthickness. In one embodiment, the elongate member 2002 can include aplurality of materials having different thermal properties.

In another embodiment where portions of the elongate member 2002 havedifferent thermal properties that are in parallel, rotation of theelongate member 2002 can provide the ability to change the thickness,stroke or swath of a line. For example, rotation 2018 of the elongatemember with respect to the touch screen 2006 is depicted. The rotation2018 can be for the orientation of the stylus 2002, and/or for the gripof the user's hand. It is understood that the thermal characteristics ofthe stylus can be sensitive to various factors including elevation,orientation and/or the user's grip, including location and strength.

In another embodiment, different thermal properties can have a linearprofile, for example from the first distal end 2004 to the second distalend 2008. In another embodiment different thermal properties can have anon-linear profile, for example from the first distal end 2004 to thesecond distal end 2008. A combination of linear and non-linear profilesis also contemplated.

As mentioned above, an element such as the elongate member 2002 caninclude one or more of at least one thermal characteristic that isvariable, at least one mechanical feature to provide at least onethermal characteristic that is variable, and at least one material toprovide at least one thermal characteristic that is variable. Thevariable thermal characteristics can include at least one of temperatureand/or heat energy. For example, an elongate member can include aplurality of materials having different thermal properties. Thematerials can include at least one of a plastic, an elastomer and/or ametal.

It is understood that thermal conductivities of metals can be selectedaccording to composition. The disclosed stylus can be tailored based onto but not limited to the following metals, including alloys of the mainconstituent, in approximate order of decreasing conductivity: silver,copper, gold, aluminum, beryllium, brasses, bronzes, magnesium, zinc,nickel, steels, and titanium.

It is also understood that various plastics can be made thermallyconductive or dissipative through selection of additives. Their physicalproperties such as hardness or color can be used to advantage indifferent embodiments of the disclosed stylus. Material can include forexample, acrylonitrile butadiene styrene (ABS), polycarbonate (PC),polypropylene (PP), polyamide (PA), polybutylene terephthalate (PBT),polyphthalamide (PPA), polyphenylene sulfide (PPS), polyether etherketone (PEEK), polyetherimide (PEI), polyamide-imide (PEI),polyoxymethylene (POM) also known as acetal, polymethylmethacrylate(PMMA) also known as acrylic.

Additionally, softer materials, such as elastomers can also be madethermally conductive or dissipative through selection of additives andcan be used to advantage in different embodiments of the invention:silicones, silicone rubbers, thermoplastic polyurethane (TPU),thermoplastic elastomers (TPE), thermoplastic polyolefin elastomers(TEO).

It is further understood that conductive additives can be used as well,such as in the housing of the stylus. Such can be varied as to size,shape, and amount, and used to tailor the invention's thermalconductivity: carbon fiber, carbon black, carbon powder, graphite,stainless steel, nickel coated graphite fiber, inherently dissipativepolymers (IDP), inherently conductive polymers (ICP), nano-materialsincluding carbon nanotubes (CNT), and/or conductive inks for surfacetreatment.

Example Embodiments of the Mobile Device

As mentioned previously, since the aforementioned mobile devices and theactive styluses are configured to at least interact with each other itis fitting to discuss other example embodiments of the mobile devices.Disclosed in this section are more examples of mobile devices that caninteract with the active styluses. Further, it should be understood thatalthough some of the terms in this section are different from some ofthe terms in the preceding sections, some of the terms in this sectionhave similar meaning to some of the terms in the preceding sections.

Referring to FIG. 21, illustrated is a block diagram of an exemplaryuser computer device 2102 in accordance with an embodiment of thepresent invention. User computer device 2102 may be any user computerdevice that allows a user to input instructions to the device via atouch screen 2104 and, optionally, may be capable of sending andreceiving communication signals on a wireless network. Preferably, usercomputer device 2102 is a wireless mobile device, such as a cellulartelephone, a radio telephone, a smart phone, or a personal digitalassistant (PDA), a laptop computer or a tablet computer with radiofrequency (RF) capabilities, or any other handheld or portableelectronic device with a user interface comprising a touch screen 2104that allows a user to input instructions into the user computer device;however, user computer device 2102 may be any type of user computerdevice, such as a personal computer or a laptop or tablet computerwithout wireless capabilities, that has a user interface that includes atemperature sensitive touch screen. User computer device furthercomprises a housing 2120 with a front side 2122 that includes touchscreen 2104, side edges 2124, and a back side 2126.

Referring now to FIGS. 21 and 22, touch screen 2104 is a ‘temperaturesensitive’ touch screen that includes a touch screen panel 2106,typically an insulator such as glass, and a temperature sensitive userinterface 2108. Temperature sensitive user interface 2108 includestemperature sensing componentry that allows for detection of atemperature differential existing between different locations on touchscreen 2104. The temperature sensing componentry more particularlyincludes multiple temperature sensing devices 2110 positioned proximateto, or embedded in, panel 2106 of touch screen 2104. As will bedescribed further below, temperature signals are provided from thetemperature sensing devices 2110 that are indicative of the temperaturesat those respective temperature sensing devices. The multipletemperature sensing devices 2110 also are capable of generating thermalenergy that may be sensed by user of the device.

By virtue of processing performed by user computer device 2102 utilizingthe information communicated by way of temperature signals, the usercomputer device is able to sense a temperature differential existingbetween the temperatures sensed by different sensing devices (ordifferent groups of sensing devices) which is indicative of atemperature differential existing between the locations of thosedifferent sensing devices (or groups of sensing devices). Thistemperature differential information then may used in combination withother information obtained via other types of sensors by user computerdevice 2102 to determine/predict an operational condition or context ofthe user computer device.

Referring now to FIGS. 23-5, block diagrams are depicted of usercomputer device 2102 in accordance with various embodiments of thepresent invention. Referring first to FIG. 23, user computer device 2102includes a processor 2302 such as one or more microprocessors,microcontrollers, digital signal processors (DSPs), combinations thereofor such other devices known to those having ordinary skill in the art.The particular operations/functions of processor 2302, and respectivelythus of user computer device 2300, are determined by an execution ofsoftware instructions and routines that are stored in a respective atleast one memory device 2304 associated with the processor, such asrandom access memory (RAM), dynamic random access memory (DRAM), and/orread only memory (ROM) or equivalents thereof, that store data andprograms that may be executed by the corresponding processor. However,one of ordinary skill in the art realizes that the operations/functionsof processor 2302 alternatively may be implemented in hardware, forexample, integrated circuits (ICs), application specific integratedcircuits (ASICs), a programmable logic device such as a PLD, PLA, FPGAor PAL, and the like, implemented in the user computer device. Based onthe present disclosure, one skilled in the art will be readily capableof producing and implementing such software and/or hardware without undoexperimentation. Unless otherwise indicated, the functions describedherein as being performed by user computer device 2102 are performed byprocessor 2302.

User computer device 2102 further includes a user interface 2308 and,optionally, a transceiver 2310 and a location determination module 2316,that are each coupled to processor 2302. Transceiver 2310 includes atleast one wireless receiver (not shown) and at least one wirelesstransmitter (not shown) for receiving and transmitting wireless signals,such a radio frequency (RF) signals and/or short-range signals such asBluetooth signals. Location determination module 2316, such as a GPS(Global Positioning Satellite) module comprising a GPS receiver,determines a geographical location of the user computer device. Userinterface 2308 includes a display screen that comprises ‘thermallysensitive’ touch screen 2104, and further may include a keypad, buttons,a touch pad, a joystick, an additional display, or any other deviceuseful for providing an interface between a user and an electronicdevice such as user computer device 2102. The display screen may be aliquid crystal display (LCD), a light emitting diode (LED) display, aplasma display, or any other means for visually displaying information.

User computer device 2102 further includes a touch screen driver 2306that is maintained in at least one memory device 2304 and that isexecuted by processor 2302, and temperature sensors 2312 and othersensors 2314 associated with the touch screen and in communication withthe processor. To the extent FIG. 23 is intended to show the internalcomponents of user computer device 2102, the temperature sensors 2312include temperature sensing devices 2110. Depending upon the embodiment,temperature sensors 2312 can include any arbitrary number of temperaturesensing devices, and the temperature sensors can include a variety ofdifferent types of temperature sensing devices. With respect to theother sensors 2314, these can include any one or more of a variety ofdifferent types of sensors. In the present embodiment, the other sensors2314 can include a capacitive touch sensor and/or a resistive touchsensor or any other type of touch-sensitive component. User computerdevice 2102 also includes a power supply 2318, such as a power converterfor interfacing with a power outlet or a limited life power supply suchas a removable and/or rechargeable battery, for providing power to theother internal components 2302, 2304, 2308, 2310, 2312, 2314, and 2316of user computer device 2102.

Touch screen driver 2306 comprises data and programs that control anoperation of touch screen 2104, such as sensing a temperature change intemperature sensitive user interface 2108 of the touch screen anddetermining a location of a touch on the touch screen, and that mayreconfigure an operation of the touch screen as described in greaterdetail below. In addition to being a temperature sensitive touch screen,touch screen 2104 also may be a ‘capacitive’ touch screen as is known inthe art. For example, touch screen panel 2106, typically an insulatorsuch as glass, may be coated, on an inner surface, with a capacitiveuser interface 2114 comprising a transparent electrical conductor, suchas indium tin oxide (ITO). In other examples of a capacitive touchscreen, capacitive user interface 2114 may comprise a grid-type patternof metallic electrodes that may be embedded in touch screen panel 2106or etched in a conductor coupled to an inner surface of the touch screenpanel. The electrical conductor is, in turn, coupled processor 2302 andis controlled by touch screen driver 2306. Touching the outer, uncoatedsurface of touch screen panel 2106 with an electrical conductor, such asa human body or a capacitive stylus, results in a change in anelectrostatic field and a corresponding change in capacitance that isdetected by touch screen driver 2306.

As noted above, touch screen 2104 is a temperature sensitive touchscreen, for example, as described in U.S. patent application number212/774,509, attorney docket no. CS37431, entitled “Mobile Device withTemperature Sensing Capability and Method of Operating Same,” and filedon May 25, 22010, and which description of a thermally sensitive mobiledevice touch screen is hereby incorporated herein. Temperature sensitiveuser interface 2108 may be proximate to an inner surface of touch screenpanel 2106 or may be embedded in the panel. For example, the multipletemperature sensing devices 2110 may be embedded in, or may be attachedto on an inner surface of, the touch screen panel. Temperature sensingdevices 2110 are devices that sense an applied temperature and output anindication of the sensed temperature, such as a thermocouple formed by arespective junction of first and second types of materials, for example,a Indium Tin Oxide (InSnO4) ceramic material (ITO) and a Indium TinOxide Manganese ceramic material (ITO:Mn), and may be distributedthroughout touch screen 2104 (in a different plane, that is, above orbelow the capacitive user interface associate with the touch screen, orintermixed with the capacitive user interface).

Certain temperature sensing devices 2110 may be linked to each other bya graphite strip or other thermally-conductive strip so as to maintainthe temperature sensing devices at a same or substantially a sametemperature, which temperature may be set at a temperature leveldifferent from that of an item that will touch screen 2104, such as anexposed finger, a gloved finger, or a stylus. Temperature sensingdevices 2110 also may be electrically connected in series to enhancetouch sensitivity as well as to enable differential drive functionality.Junctions connected in series result in alternating junction polaritiesdue to thermocouple conductor type order. Junctions in phase are groupedtogether for additive response and those with opposite polarities areseparated and in some cases used to drive opposing device sides fordifferential response. In yet other cases, opposing polarity junctionsare kept at a known and same temperature for reference and are enabledby applying a Graphite type material in their vicinity. By grouping samepolarity junctions, touch sensitivity is enhanced. As a result, when twoof the temperature sensing devices 2110 that share a same polarity eachexperience a same temperature, the voltages generated by the temperaturesensing devices all tend to increase (or decrease) generally uniformlyand tend to be additive, and the resulting output voltage experienced atterminals connected to the temperature sensing devices (which voltageis, in turn, read by processor 2302 implementing touch screen driver2306) will be the sum of the contributions from those temperaturesensing devices. Whereas when two of the temperature sensing devices2110 that are of opposite polarity each experience a same temperature, avoltage increase (or decrease) generated by one of the temperaturesensing device due to the particular temperature will tend to be offsetby a corresponding voltage increase (or decrease) generated by the otherof the temperature sensing device. Thus processor 2302 is able todetermine a location of a touch based on temperature differentials.

Turning to FIG. 24, an electrical schematic diagram 2400 is providedshowing how signals from temperature sensing devices 2110 can beprocessed to derive a differential temperature signal, as well as howthat differential temperature signal can be processed along with othersignals from other supporting sensors 2314, in accordance with anembodiment of the present invention. As shown, two temperature sensingdevices 2110 (depicted in FIG. 24 as temperature sensing devices 2110Aand 2110B) are coupled in series, between an inverting input 2452 and anon-inverting input 2454 of an operational amplifier 2456. Moreparticularly, a first lead 2412 of a first temperature sensing device2110A of the two temperature sensing devices 2110A and 2110B, is coupledto the inverting input 2452, a first lead 2422 of a second temperaturesensing device 2110B of the two temperature sensing devices 2110A and2110B is coupled to the non-inverting input 2454, and a second lead 2414of the first temperature sensing device 2110A is coupled to a secondlead 2424 of the second temperature sensing device 2110B. In response toinput signals, for example, voltage or current signals, generated by thefirst and second temperature sensing devices (or groups of devices)2110A, 2110B, operational amplifier 2456 generates an output signal atoutput terminal 2458 that is proportional to the differential betweenthe two input signals and thus proportional to the difference intemperatures experienced by the two temperature sensing devices 2110A,110B.

Additionally as shown in FIG. 24, the differential temperature outputsignal provided at output terminal 2458 is sent to processor 2302 by wayof a communication link 2460 (although not shown, an analog-to-digitalconverter can be provided as part of communication link 2460 betweenoutput terminal 2458 and processor 2302 so that the differentialtemperature output signal is in digital form when provided to processor2302). In addition to receiving the differential temperature outputsignal, processor 2302 also receives one or more signals from one ormore other sensors 2314, for example, by way of additional communicationlinks 2432 and 2434, respectively. It should be further noted that,while for simplicity of illustration, in FIG. 23 the temperature sensingcircuitry depicted in FIG. 24 are all considered to be part oftemperature sensors 2312 (along with the temperature sensing devices2110A and 2110B), in other embodiments such devices/components otherthan the specific components that sense temperature can be considered tobe distinct from the temperature sensors, and can be located physicallyapart from the temperature sensors. For example, the operationalamplifier 2456 can, in another embodiment, be considered part of theprocessor 2302. Depending upon the signals provided to it from thetemperature sensors 2312 and the other sensors 2314, processor 2302 candetermine a variety of operational conditions/contexts as will bediscussed in further detail below.

Referring now to FIG. 25, a schematic diagram is provided of anexemplary layout of multiple temperature sensing devices 2110 as can bearranged on user computer device 2102 in accordance with an embodimentof the present invention. As illustrated by FIG. 25, each of multipletemperature sensing devices 2110, depicted in FIG. 25 as temperaturesensing devices 21101-1108 (eight shown), is a thermocouple formed by arespective junction of an ITO lead and an ITO:Mn lead, and these leadsare all interconnected in a manner by which all of the temperaturesensing devices 21101-1108 are connected in series between a firstterminal 2550 and a second terminal 2552. Further as shown, the firstand second terminals 2550 and 2552 respectively are coupled torespective copper wires 2554, 2556 that are surrounded by a flexibleplastic sheathe 2558 so as to form a two-wire flex link. Although shownin cut-away, it will be understood that the copper wires 2554, 2556 andsheathe 2558 extend away from the terminals 2550, 2552 and allow thoseterminals to be coupled to other components (for example, to anoperational amplifier that is, in turn, coupled to processor 2302).

More particularly as shown, the first terminal 2550, an ITO lead, islinked to a first temperature sensing device 21101 of the multipletemperature sensing devices 21101-1108 by way of a first ITO lead 2520,and that temperature sensing device is, in turn, linked to a secondtemperature sensing device 21102 of the multiple temperature sensingdevices 21101-1108 by way of a first ITO:Mn lead 2530. A second ITO lead2522 extends from the second temperature sensing device 21102 to a thirdtemperature sensing device 21103 the multiple temperature sensingdevices 21101-1108, and a second ITO:Mn lead 2532 links the thirdtemperature sensing device 21103 to a fourth temperature sensing device21104 of the multiple temperature sensing devices 21101-1108. A thirdITO lead 2524 in turn links the fourth temperature sensing device 21104to a fifth temperature sensing device 21105 of the multiple temperaturesensing devices 21101-1108, which then is connected to a sixthtemperature sensing device 21106 of the multiple temperature sensingdevices 21101-1108 by way of a third ITO:Mn lead 2534. The sixthtemperature sensing device 21106 is, in turn, connected to a seventhtemperature sensing device 21107 of the multiple temperature sensingdevices 21101-1108 by way of a fourth ITO lead 2526. Finally the seventhtemperature sensing device 21107 is connected to an eighth temperaturesensing device 21108 by way of a fourth ITO:Mn lead 2536. The eighthtemperature sensing device 21108 is linked, by way of a fifth ITO lead2528, to the second terminal 2552, which is also an ITO lead.

In implementing thermocouple-type temperature sensing devices 2110, themanner in which each temperature sensing device 2110 is interconnectedwith other components (and the correspondent polarity of the devicerelative to other components) often is of significance in implementingthe temperature sensing device, particularly where multiple temperaturesensing devices of this type are connected in series. For example, in anembodiment in which there are two thermocouple-type temperature sensingdevices 2110 that are interconnected as shown in FIG. 24, it is typicalthat the respective polarities of the temperature sensingdevices/thermocouples will be oppositely-orientated so as to allow fordifferential temperature sensing. Given such an orientation, assumingthat the two temperature sensing devices 2110 each experience the sametemperature, a voltage increase (or decrease) generated by one of thetemperature sensing devices due to the particular temperature will tendto be offset by a corresponding voltage increase (or decrease) generatedby the other of the temperature sensing devices. Alternatively, assumingthat there is a temperature differential between the two temperaturesensing devices 2110 such that the two devices output differentvoltages, the difference between those voltages will be experienced byan operational amplifier across terminals 2550 and 2552.

The embodiment of user computer device 2102 depicted in FIG. 25 is anexemplary embodiment in which multiple temperature sensing devices 2110are distributed at three different general regions along an innersurface of touch screen 2104 of the user computer device.Notwithstanding the fact that more than two temperature sensing devices2110 are employed and coupled together in series, it is possible toobtain meaningful temperature information because of the particularmanner in which the temperature sensing devices are interconnected. Aswill be noticed from FIG. 25, each of the temperature sensing devices21102, 21104, 21106, and 21108 that are located proximate a bottom edge2562 of touch screen 2104 are formed by the intersection of a respectiveone of the ITO:Mn leads extending away from the respective temperaturesensing device generally upwardly and a respective ITO lead that extendsaway from each of those respective temperature sensing devices alsogenerally upwardly but to the right of the respective ITO lead for thattemperature sensing device (except in the case of the eighth temperaturesensing device 2408, from which the ITO lead extends downwardly). Bycomparison, each of the first and seventh temperature sensing devices21101, 21107 towards the mid-region 2564 of touch screen 2104 isconnected to a respective one of the ITO leads extending away from thattemperature sensing device generally downwardly and also to one of theITO:Mn leads extending generally downwardly and to the right of therespective ITO lead for that device (it is the same for the third andfifth temperature sensing devices 21103, 21105 near the top edge 2566 oftouch screen 2104).

Given this type of configuration, the second, fourth, sixth, and eighthtemperature sensing devices 21102, 21104, 21106, and 21108 all share afirst polarity, while the first, third, fifth, and seventh temperaturesensing devices 21101, 21103, 21105, and 21107 all share a secondpolarity that is opposite the first polarity. Consequently, should ahigh temperature be experienced generally along the bottom region of themobile device 2562 proximate the sensing devices 21102, 21104, 21106,and 21108, the voltages generated by those respective temperaturesensing devices all tend to increase (or decrease) generally uniformlyand tend to be additive, and the resulting output voltage experienced atthe terminals 2550 and 2552 will be the sum of the contributions fromthose four sensing devices. Such reinforcing behavior of the temperaturesensing devices 21102, 21104, 21106, and 21108 is particularlyfacilitated by the presence of the graphite strip 2570. Likewise, if aparticular temperature is experienced along the top edge 2566 or themid-region 2562, then the pairs of temperature sensing devices21103/1105 and 21101/1107 at those respective locations will tend togenerate voltages that are additive and reinforcing of one another, andthe resulting output voltage experienced at the terminals 2550, 2552will be the sum of the contributions of any one or more of thosetemperature sensing devices.

It should be noted that the configuration of FIG. 25 is reflective ofcertain assumptions regarding the operation of user computer device2102. In particular, the arrangement of the multiple temperature sensingdevices 21101-1108 presumes that it is unlikely that a user will touch(that is, apply heat proximate to) both one or more of the temperaturesensing devices 21102, 21104, 21106, and 21108 near the bottom edge 2562while at the same time touch one or more of the temperature sensingdevices 21101, 21103, 21105, and 21107 at the mid-region 2564 or nearthe top edge 2566. Rather, typically a user will only touch one or moreof the temperature sensing devices near the bottom edge 2562 or touchone or more of the other temperature sensing devices 21101, 21103,21105, and 21107, but not both. Such an assumption is especiallyplausible if the placement of some of the temperature sensing devices isat or proximate to a location on user computer device 2102 at which heatis less likely to be applied (for example, near a microphone on a mobiledevice). Given this assumption, it is unlikely that the voltagesgenerated by the temperature sensing devices 21102, 21104, 21106, and21108 will be cancelled out by the voltages generated by the temperaturesensing devices 21101, 21103, 21105, and 21107 due to touching of theuser computer device by a user.

The configuration of FIG. 25 additionally illustrates how, in someembodiments of the present invention, various advantages can be achievedby utilizing multiple temperature sensing devices provided within agiven region of touch screen 2104 rather than utilizing only a singletemperature sensing device to sense a temperature at a given region ofthe touch screen. In particular, FIG. 25 shows that multiple temperaturesensing devices, such as the devices 21102, 21104, 21106, and 21108 canbe collectively employed, effectively as a single ‘group sensor,’ so asto sense the temperature within a given region of touch screen 2104,that is, proximate the bottom edge 2562 of the touch screen. Likewise,FIG. 25 shows that the multiple temperature sensing devices 21101,21103, 21105, and 21107 can be collectively employed, again effectivelyas a group sensor (or as multiple group sensors each made up of twotemperature sensing devices), to sense the temperature(s) at either oneor both of the mid-region 2564 and proximate the top edge 2566 of touchscreen 2104. Insofar as these temperature sensing devices operate asgroup sensors, temperature changes occurring nearing any of the sensingdevices of the group sensor are sensed quickly. This is in contrast toother embodiments where only a single temperature sensing device ispresent within a given region, such that temperature changes must becommunicated to the location of that particular temperature sensingdevice before those changes are sensed.

Additionally, FIG. 25 illustrates how in some operational conditions itis possible for a variety of different temperature conditions within avariety of different regions of the mobile device can be sensed simplyby series-connecting any arbitrary number of temperature sensing devices2110 and using the simple hardware shown in (or hardware similar to thatshown in) FIG. 24. In particular, it will be understood from FIG. 25that temperature changes experienced proximate the bottom edge 2562 oftouch screen 2104 will have twice the effect as temperature changesexperienced merely within the mid-region 2564 of the touch screen, sincefour of the temperature sensing devices are located near the bottom edge2562 while only two of the temperature sensing devices are located nearthe mid-region 2564.

Similarly, in other embodiments, by providing different numbers oftemperature sensing devices 2110 at different regions of interest aroundtouch screen 2104, the overall voltage signals produced by theseries-connection of those temperature sensing devices can beinterpreted to determine temperature changes occurring at (andtemperature differentials occurring between) those numerous differentregions of the touch screen. For example, assuming a hypotheticalarrangement in which four temperature sensing devices were located in afirst region, for example, a 5 millimeter (mm) circle, and a fifthtemperature sensing device was located in a second region, for example,another 5 mm circle, and assuming that all of the temperature sensingdevices were connected in series but the fifth temperature sensingdevice was oppositely connected in terms of its polarity relative to theother four, then temperature changes occurring at the first region wouldhave four times the impact upon the overall output voltage of the fiveseries-connected temperature sensing devices than temperature changesoccurring in the second region, and thus the overall output voltagecould be interpreted accordingly.

Numerous other embodiments with numerous other types of temperaturesensing devices 2110 and configurations thereof are additionallyintended to be encompassed by the present invention. For example, setsof multiple temperature sensing devices 2110 positioned proximate todifferent edges of the touch screen can all be connected in series withone another. Also for example, where a set of temperature sensingdevices 2110 are intended to operate as a ‘group sensor’ associated witha particular region of the touch screen, the proximity of thosetemperature sensing devices with respect to one another can varydepending upon the embodiment. Further, for example, in someembodiments, one or more temperature sensing devices 2110 can serve as atouch sensor. For example, by placing temperature sensing devices 2110along sides edges 2124 of user computer device 2102, it is then possibleto determine which side of the user computer device is warmer and thenconclude that the warmer side is the side that the user is holding.

Further, in some embodiments, sensed temperature information (includingsensed temperature information available from groups of sensors) can beinterpreted as an indication of keypad entries or other user inputsignals or instructions. In one embodiment of this type, a first set oftemperature sensing devices 2110, for example, 220 temperature sensingdevices, can be placed within a first region of touch screen 2104 andserve as a first ‘button’ while a second set of temperature sensingdevices 2110 different in number, for example, one device, can be placedin a second region and serve as a second ‘button.’ Assuming all of thetemperature sensing devices 2110 of the two sets are coupled in series,the user computer device then can detect whether the first region or thesecond region is touched based upon whether a voltage signal that isdetected is large, for example, from the 220 devices, due to heating ofthe first region from the user's finger, or small, for example, from theone device, due to heating of the second region from the user's finger.

Further, in still other embodiments of the present invention,temperature sensing devices 2110 may be implemented so that thermocouplejunctions are situated immediately along the exterior of the touchscreen (that is, the junctions just pierce out of the mobile device as“dots”). Such embodiments can provide even more rapid response times, interms of how fast temperature changes are sensed, than embodiments wherethe thermocouple junctions are embedded within a touch screen (much lesswhere the junctions are beneath overlying structures). In general, forquickest sensing/response times, it is desirable to minimize thedistance between the thermocouple junction and the heat source.

1. A method, comprising: producing at least one analog heat signal by atleast one heat source of a mobile device, wherein the mobile device hasa display and a temperature signal adjustment mechanism for increasingand decreasing temperature of the at least one analog heat signal, andthe at least one analog heat signal is configured to be detectable by atleast one thermocouple junction of a stylus; and transmitting the atleast one analog heat signal from the display of the mobile device forreceipt by the at least one thermocouple junction of the stylus.
 2. Themethod of claim 1, wherein the receipt of the at least one analog heatsignal by the at least one thermocouple junction of the stylus is at oneor more ends of the stylus.
 3. The method of claim 1, furthercomprising: receiving the at least one analog heat signal at the atleast one thermocouple junction of the stylus; transforming the at leastone analog heat signal to a digital electric signal; and inputting thedigital electric signal as a parameter of executed processor readableinstructions stored on a processor readable storage medium of thestylus.
 4. The method of claim 1, wherein the signal adjustmentmechanism for increasing and decreasing the temperature of the at leastone analog heat signal has a power source that provides an amount ofcurrent to the at least one heat source, so that increasing the amountof current raises the temperature of the at least one analog heat signaland decreasing the amount of current lowers the temperature of the atleast one analog heat signal.
 5. The method of claim 4, wherein the atleast one heat source of the mobile device includes a thermocouplejunction.
 6. The method of claim 5, wherein the thermocouple junction ofthe mobile device is part of a thermocouple junction network.
 7. Themethod of claim 1, further comprising: outputting from a shaft of thestylus tactile feedback due to the inputting of the digital electricsignal as the parameter of the executed processor readable instructionsstored on the processor readable storage medium of the stylus.
 8. Themethod of claim 1, where in addition to the temperature of the at leastone heat signal the duration of the heat signal is also a parameter ofthe heat signal.
 9. The method of claim 1, wherein the signal adjustmentmechanism for increasing and decreasing the temperature of the at leastone analog heat signal includes a push button having at least two statesfor varying the at least one analog heat signal by at least twodifferent temperatures distinguishable to the at least one thermocouplejunction of the stylus.
 10. The method of claim 1, wherein the signaladjustment mechanism for increasing and decreasing the temperature ofthe at least one analog heat signal includes a slider or a knob havingat least two states for varying the at least one analog heat signal byat least two different temperatures distinguishable to the at least onethermocouple junction of the thermocouple junction network.
 11. A mobiledevice for interacting with a stylus, wherein the stylus has at leastone thermocouple junction, and wherein the mobile device comprises: atleast one heat source that produces at least one analog heat signal,wherein the at least one analog heat signal is configured to bedetectable by the at least one thermocouple junction of the stylus; asignal adjustment mechanism for increasing and decreasing temperature ofthe at least one analog heat signal; and a display, configured totransmit the at least one analog heat signal for receipt by the at leastone thermocouple junction of the stylus.
 12. The mobile device of claim11, wherein the receipt of the at least one analog heat signal by the atleast one thermocouple junction of the stylus is at one or more ends ofthe stylus.
 13. The mobile device of claim 11, wherein: the at least onethermocouple junction of the stylus is configured to receive the atleast one analog heat signal; and the at least one thermocouple junctionof the stylus transforms the at least one analog heat signal into adigital electric signal that is input for executed processor readableinstructions stored on a storage medium of the stylus.
 14. The mobiledevice of claim 11, wherein: the signal adjustment mechanism forincreasing and decreasing the temperature of the at least one analogheat signal has a power source that provides an amount of current to theat least one heat source; and increasing the amount of current raisesthe temperature of the at least one analog heat signal and decreasingthe amount of current lowers the temperature of the at least one analogheat signal.
 15. The mobile device of claim 11, wherein the at least oneheat source of the mobile device includes a thermocouple junction. 16.The mobile device of claim 15, wherein the thermocouple junction of themobile device is part of a thermocouple junction network.
 17. The mobiledevice of claim 11, further comprising: outputting from a shaft of thestylus tactile feedback due to the inputting of the digital electricsignal as the parameter of the executed processor readable instructionsstored on the processor readable storage medium of the stylus.
 18. Themobile device of claim 11, where in addition to the temperature of theat least one heat signal the duration of the heat signal is also aparameter of the heat signal.
 19. A mobile device for interacting with astylus, wherein the stylus has at least one sensor, and wherein themobile device comprises: at least one analog signal source that producesat least one analog signal, wherein the at least one analog signal isconfigured to be detectable by the at least one sensor of the stylus; ansignal adjustment mechanism for changing the at least one analog signal;and a transmitter, configured to transmit the at least one analog signalfor receipt by the at least one sensor of the stylus.
 20. The mobiledevice of claim 19: wherein the least one sensor of the stylus includesa electromagnetic signal receiver; and wherein the at least one analogsignal source and the transmitter of the mobile device includes anelectromagnetic transmitter.
 21. The mobile device of claim 19, wherein:the at least one sensor of the stylus is configured to receive the atleast one analog signal; and the at least one sensor of the stylustransforms the at least one analog signal into a digital electric signalthat is input for executed processor readable instructions stored on astorage medium of the stylus.